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Abstract. We derive various exact results for Markovian systems that spontaneously 
relax to a non-equilibrium steady-state by using joint probability distributions 
symmetries of different entropy production decompositions. The analytical approach 
is applied to diverse problems such as the description of the fluctuations induced by 
experimental errors, for unveiling symmetries of correlation functions appearing in 
fluctuation-dissipation relations recently generalised to non-equilibrium steady-states, 
and also for mapping averages between different trajectory-based dynamical ensembles. 
Many known fluctuation theorems arise as special instances of our approach, for 
particular two- fold decompositions of the total entropy production. As a complement, 
we also briefly review and synthesise the variety of fluctuation theorems applying to 
stochastic dynamics of both, continuous systems described by a Langevin dynamics and 
discrete systems obeying a Markov dynamics, emphasising how these results emerge 
from distinct symmetries of the dynamical entropy of the trajectory followed by the 
system. For Langevin dynamics, we embed the "dual dynamics" with a physical 
meaning, and for Markov systems we show how the fluctuation theorems translate 
into symmetries of modifled evolution operators. 
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1. Introduction 

The study of the fluctuating heat interchange between a small system and a thermal 
reservoir is of academic interest but also of direct experimental relevance, as new 
techniques for microscopic manipulation and detection allow nowadays to measure 
fluctuations in small experimental systems of relevance in Physics, Chemistry and 
Biology [1, 2]. At this respect, a group of relations known as fluctuation theorems 
(FT) [3, 4, 5, 6, 7, 8, 9, 10, 11] have attracted a lot of attention as they shed a new 
light into the principles governing energy fluctuations in a family of model systems. 
Remarkably, these results go beyond linear-response or quasi-equilibrium conditions, 
and apply to systems driven by non-conservative forces with arbitrary time-dependent 
protocols, even feedback controlled [12, 13, 14]. 

Formally, the generality of the FTs can be attributed to the way probability 
distribution functions of particular observables behave under symmetry-breaking 
forcings, such as non-conservative and/or time dependent forces (see [15, 16] for reviews 
on FT). Although the FTs are not expected to hold for every experimental system 
in contact with a thermal bath, they still provide a nice framework to analyse and 
understand the fluctuating heat interchange of out of equilibrium systems in general. 
Here we focus, as in most of the recent works in this field, on the family of systems 
whose driven dynamics can be well described by Langevin equations (without memory) 
or by discrete Markov chains. These are the prototypical models for which most FTs can 
be proven easily, without making any additional assumptions. (Note that fluctuation 
theorems have also been derived for non-Markovian dynamics [17, 18].) 

FTs are exact relations for the probability distributions for the values W 
of observables W[x;(t] which are functionals of the stochastic state-space system 
trajectories x = {x(t)}[^o {^-9- work, heat or more generally, different forms of 
trajectory-dependent entropy productions) in processes driven by an arbitrary time- 
dependent protocol a{t) during a time r. Typically, the so-called integral fluctuation 
theorems (IFTs) are exact relations for the thermal average over histories such as 
(e~^) = 1 while detailed fluctuations theorems (DFTs) for the same observable are 
stronger relations, typically of the form P{W) / P'^{—W) = , involving the probability 
distributions P{W) = {6{W[^;a] - W)) and P^{W) = {6{W[^;a] - W))^ of the 
stochastic values W of W, with T denoting that the trajectories x are sampled from a 
transformed (typically time-reversed) dynamics such that = — W. 

The observable W is thus convenient to measure the asymmetry under the 
transformation T. Indeed, (W) = Dkl{P{W) \\ P^{-W)), with Dkl{Pa \\ Pb) the 
KuUback-Leibler distance between two distributions Pa and Pb- Prominent examples 
for physically relevant observables W are the total entropy production 5'tot which yields 
the Jarzynski IFT [7] and Crooks DFT [8], the non-adiabatic entropy S^^ produced in 
transitions between non-equilibrium steady-states yielding the Hatano-Sasa IFT [9] and 
DFT [20], and the adiabatic entropy production S'a, yielding the Speck-Seifert IFT [10] 
and DFT [19]. 
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A simple unifying picture for all these seemingly different FTs has emerged recently 
[11, 19, 20]. Although a DFT trivially includes as a particular case an IFT it is now 
clear that there exist two basic operations T that we can use for generating the DFT 
version corresponding to each of the above mentioned IFTs. These two operations are 
time-reversal (R), which reverses the protocol maintaining the form of the dynamical 
equations, and the transformation to the so-called dual dynamics (f), which corresponds 
to different dynamical equations. These transformations are interesting since they are 
closely related to symmetry operations of equilibrium and non-equilibrium steady-states. 
The above mentioned FTs can indeed be all unified in three detailed fluctuation theorems 
[19, 21, 22] satisfied by the the total entropy production S-tot, and by each term of 
its particular two-fold decomposition, S'tot = •S'a -|- Sna, into an adiabatic Sa and a 
non-adiabatic part S^g,- This splitting is physically motivated and closely related, for 
isothermal processes, to the splitting Qtot = Qhk + Qexc of the total work done by 
all forces, into a house-keeping heat Qhk and an excess heat Qexc, proposed by Oono 
and Paniconi [23] and later formalised by Hatano-Sasa [9] for describing steady-state 
thermodynamics. The three DFT read 



where in the second equation the dual and the the time-reversal operations are 
composed. As we can see, at variance with the DFT for S'tot, where the distribution 
of S'tot for the forward process is compared with the one for the backward process 
obeying a time-reversed protocol, the detailed fluctuations theorems for Sg, and Sna. 
require comparing the forward process with a process governed by the adjoint dynamics 
(which can be additionally time-reversed), which is very different from the original 
physical dynamics and therefore difficult to impose experimentally in general. 

In a recent paper we have shown that writing detailed theorems in terms of joint 
probabilities is a convenient approach for deriving easily a family of relations, including 
the three detailed FTs, which might prove relevant for diverse applications. Introducing 
joint distributions is on the other hand natural when we are interested in the path 
dependent fluctuations of non-scalar observables. Indeed more general transformations 
T such as vector rotations [24] can be also considered for deriving joint-distributions 
FTs. In this work we provide more detailed calculations and expand the results of [25] , 
and then propose new applications. 

The organisation of the paper is as follows. In Section 2 we review various 
FTs and introduce the notations and basic observables used in the next sections. 
In Section 2.4 we review the main results of our previous work, and give their 
detailed derivation using Langevin dynamics in its path-integral (Onsager-Machlup) 
representation (paragraph 3.1) and Markov chains (paragraph 3.2). In Section 4 we 
discuss some applications of our results. Conclusions and perspectives are gathered in 
Section 5. 



P{S-tot)/P ( S'tot 
P(5na)/P^^(-Sna) 




(1) 

(2) 
(3) 
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2. Fluctuation theorems preliminaries 

It is clear that given two different dynamical weights P[x;a] and P"^[x;(t] for the 
stochastic trajectories x = {x{t)}l^Q of a given system, we can always define a trajectory 
dependent quantity 

W[x;a] = ln(P[x;a]/P^[x;(T]). (4) 
which satisfies, by construction, the symmetry relation 

(0[x;a]),„ = (O[x;a]e^[''-l)J^, (5) 

where (...) = / r'xP[x; a]..., (...)^ = / r'xP^[x; a]..., with initial conditions sampled 
from the arbitrary distributions po{x) and pi{x) respectively. The functional (9[x, cr] is 
an arbitrary observable and thus equation (5) can be used to get a detailed statistics. 
W is by construction odd under the swapping of the two dynamics, and its average over 
the first dynamics is the KuUback-Leiber distance between the two trajectory ensembles 
P[x; cr] and P^fx; cr], that is (W) = 'Di^i(P[x; cr] || V^\x.] a]). One may use the general 
equation (5) in two interesting ways: 

• Mapping trajectory ensembles: On one hand we might directly choose two 
different dynamics (through their transition probabilities or through their Langevin 
equations for instance) and use the equation to compare them quantitatively and 
from a purely information theoretical point of view. At this respect it is worth 
noting equation (5) "maps" averages of arbitrary observables O in the original 
trajectory ensemble to another average in a "target ensemble" of trajectories. An 
interesting case is the one which maps averages in a true non-equilibrium ensemble 
where detailed balance is broken (e.g. driven by non-conservative forces) to a one 
satisfying detailed balance (e.g. driven by potential forces). A particular instance 
where W does acquires also a clear physical meaning is the mapping to equilibrium 
dynamics that is discussed in section 4.2.3. 

• Symmetry transformations and entropy production: On the other hand, 
instead of choosing a "target" dynamics, we might focus on the properties of 
the original dynamics and directly choose transformations T of it connected to 
symmetries of their equilibrium and non-equilibrium steady-states (NESS). As it 
is well known and we briefly review in the next sections, what make this case 
specially interesting is that for such special transformations usually W acquires a 
well deflned physical meaning as generalised trajectory entropy productions. As 
we show in the following sections, time-reversal and the transformation to the so 
called "dual" dynamics yield the three detailed theorems of (3) and thus many 
known fluctuations theorems of great relevance in stochastic thermodynamics. 

2.1. Time-reversed dynamics 

In the time-reversed dynamics, T = R, trajectories are still governed by the original 
dynamical equations, with a time-reversed protocol (T^{t) = a{T — t). When a system 
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is driven out of equilibrium, either by non-conservative or time dependent forces, the 
resulting asymmetry is e.g. measured by comparing the statistical weights of two "twin 
trajectories" [20] x and such that their components are related as x^(t) = x{t — t), 
that is X is evolved with a{t) and and x^ with cr^{t). A convenient measure between 
the two weights is the functional 

5[x;a]=ln(P[x;a]/P«[x^;a^]), (6) 

defined from the statistical weight ^[x; a] of system trajectories x evolved, starting from 
an initial condition distribution Prob[a;(0) = s] = Po{s), during a given time interval r 
in a c?-dimensional state space under the action of forces controlled by an arbitrary set 
a = a{t) of time-dependent external parameters [5, 6, 11]. Here V^[x^; a^] denotes the 
statistical weight of the trajectory x but evolved backwards, x^{t) = x{t — r), and with 
the backward protocol cr^(t) = cr(r — t), sampled from an initial condition distribution 
Prob[x'^(0) = s] = Pi{s). For instance, for a Langevin dynamics we typically have 

P[x;0-] ~ Jo dt C[x,x;a]+lnpo{x{0)) ^ -pR^^R.^^Rl^ ^ g- /J" dt £[x«,i«;a«]+lnpi (a;«(0)) ^ whcre 

C[x,x]a] is the dynamical action of the system which, in general, also contains the 
logarithm of a Jacobian, whose form depends on the considered stochastic calculus. 
By making a simple change of variables, we easily derive iS[x; cr] ~ — dt {C[x, x; a] — 
C[x, —x; a])— ln(po(a;(0))/]9i(x(r))) (see Section 3.1). From (6) we have, by construction, 
that S is odd under T = R, that is, 5[x^; cx^] = — 5[x; a], since R is an involution. We 
also note that the definition of S allows us to write, for the average of any observable 
0[x;a] 

(0[x;a]) = (O[x^;a]e-^[-^'^"])^ (7) 

where (...) = J Px V[K;a]... and {■■■)^ = J 2^x P-^[x; cr^]... denotes the average over 
forward and reversed trajectories respectively. We note also that the concept of twin 
trajectories used to define S is irrelevant in the last equation since on each side we 
integrate over all possible trajectories (i.e. x is now a dummy variable) and that 
J T>yi^ = J Px since x^ is simply a time reflection and shift of the trajectory x in 
time-state space. Equation (7) implies, in particular 

where in the left hand side we recognise the generating function of P{S) = (5(5[x; a] — 
S)) (we use calligraphic symbols to differentiate functionals of stochastic trajectories 
from their actual values) with A an arbitrary number we can use to compute any 
cumulant of S. Introducing P^{S) = {6{S[^;a^] — 5'))^, it is then straightforward 
to derive the detailed FT (DFT), 

P{S)/P'^{-S) = (9) 
which implies, by direct integration or by setting A = 1 above, the integral FT (IFT) 



(10) 
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and thus, by using Jensen's 



inequality we get 



(5[x;a]) >0. 



(11) 



This inequahty can also be obtained by noting that (S) is equal to the positively defined 
Kullback-Leibler distance between two probability distributions, that is, for the present 



case, (5) = j P[x; (t]5[x; ct] = VKL{V[^;a]\\V^[^^;a^]) > 0. Since the equality 



above is thus reached for time-reversal symmetric processes, at equilibrium {S) = 0, 
as expected. It is easy to show that such symmetry is actually stronger, S = 0, due 
to detailed balance. In addition, if the relaxation time of the equilibrium states is 
finite, then processes that are driven very slowly compared with it do not produce 
this quantity either, as the adiabatic process makes the system visit a sequence of the 
(sjTiimetric) equilibrium states compatible with the instantaneous value cr(t). It is also 
worth remarking here that all the above statistical properties are valid for arbitrary 
protocols o"(t), arbitrary initial conditions for the forward Pq and backward pi process, 
and they are time- independent, that is, they are valid for any r > 0. Let us note however 
that our definition of S includes a border term containing information about the initial 
condition , po and pi, of the twin processes it compares. We note also that the choice of 
Pi is free, and not a constraint for the trajectories at the border t = t however, a direct 
connection with "physical" entropy production ^tot can be done if one chooses pi being 
the solution of the Fokker-Planck (or master) equation at time r [11]. 

What makes S physically interesting in connection with stochastic thermodynamics 
is that it can be identified, up to a time border term, with the stochastic heat dissipated 
into the reservoir divided by its temperature along the stochastic system trajectory 
X, for an isothermal process. If such process is described for instance by a Langevin 
dynamics x = f{x; a) + ^, where the force f{x; a) might contain both conservative and 
non-conservative terms, it can be shown that [5, 26] (see paragraphs 3.1 and 3.2 for the 
derivation in Langevin dynamics and Markov chains situations respectively). 



where the functional of the trajectory Q*°*[x;(7] is the total work done by the force 
f{x; a) on the stochastic trajectory x under the protocol a, and the border term 
\n[po{x{0)) /pi{x{t)] depends only on the time boundaries of each stochastic trajectory, 
sampled by po and pi which remain so far arbitrary. With this identification of S, it is 
also interesting to note again that since {S) = VxLi'Pl^', o"]||'P'^[x'^; o"^]), (H) and (12) 
relate irreversibility and dissipation in an elegant information theoretical way. At this 
respect it is worth noting that in equilibrium a is constant, Po,iix) = e~^'^^^^'"''^~^'^°'^\ 
and since all forces are conservative, we have Q^°^ = E[x{0),a] — E[x{T),a], yielding 
5[x;cr] = for each stochastic trajectory x. By writing S in terms of transition 
probabilities one obtains that this is equivalent to the detailed balance condition. 




(12) 



Q*°*[x; a] 



+ In 



Pi{x{t)) 



(13) 



T 
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Equations (7-12) can be combined to derive many known FTs for Markovian 
systems. To start, by combining (7) and (12), one obtains the generalised Crooks 
relation for the average of an arbitrary observable (9[x;cr] along a trajectory with the 
forward and backward protocol, 

/ ir)totr„.„i i„ po(j:(o);°"(o)) \ r, 

l0[^-a]e-^'^ ["''^]-i%i(.M;.W) \ = (C[x;(t])^^. (14) 

We have now a lot of freedom to derive FTs, by choosing appropriate values for O, po 
and pi . 

• Seifert relation: Choosing O = 1 and pi{x) = p{x,t) to be the time-dependent 
solution of the Fokker-Planck equation with initial condition po{x) = p(x,0), we 
obtain the Seifert theorem [11], valid for all times r and arbitrary initial conditions. 
This choice defines the so-called trajectory dependent total entropy production 
Stot = Q^°^/T + Ss, with Ss = ln[p(x, r)/p(x, 0)] the trajectory dependent system 
entropy production, such that: 

(e-^*°*) = 1. (15) 

Seifert also made the interesting observation that this choice for pi is optimal in 
the sense minpJ(5)pQ] = (iStot)po- This is easy to understand if we write 

p(x(r),r 



{S - Stot)po = { In 



Pi{x{t)) 



PO 



dy p{y, r) In = VkMv, t) || pi(y)) > 0, (16) 

Pi{y> 

and use the positiveness of the KuUback-Leiber distance between any two 
distributions. 

Jarzynski relation for NESS: By choosing O = 1, pi{x) = pss{x; a{r)) and 
Po{x) = pss(a;; (j(0)) from the steady-state solution of the Fokker-Planck equation 
pss(a;; cr) we obtain the generalised Jarzynski relation for transitions between NESS, 
valid for all times r and steady-state initial conditions compatible with o"(0). 

I Pss(ct(0)) 

where <^{x\a) = —\npss{x;a). As noted by Hatano and Sasa this relation does 
not generalise the second law of thermodynamics for NESS, since its corresponding 
Jensen's inequality 

^'"^'''^U[0(x(r),a(r))-</)(x(O);a(O))]\ > 0, (18) 



T 



Pss(<t(0)) 



does not reach zero for adiabatic processes due to the presence of non- conservative 
forces which, even in the steady-state, inject energy and produce the so-called 
house-keeping heat. 
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Jarzynski relation: The IFT of equation (17) reduces to the well known Jarzynski 
relation if the initial steady-state is the Boltzmann-Gibbs equilibrium state 
pssix;a) = pcq{x;a) = e~^^^^^''^^~^^'^''\ with E{x;a) the energy of state x and 
F{(t) the free energy, under the constraint a 

where the dissipated work is >Vd[x;(T] = Q^°^[x;a] + E[x{t); x{t)] — E[x{0); a{0)] 
and AF = F(cT(r)) - F{a{0)). Again: 

(^^)p..i^m > (20) 

The equality is achieved in the adiabatic limit, and thus Jensen's inequality yields 
the second law for transitions between equilibrium states. Note that (an infinite 
number) of other second law-like inequalities can be obtained from variational 
methods [28]. 

Crooks relation: If po{x) = pcq(a^; o"(0)) and pi{x) = peq{x; a^r)), and (9[x;cr] = 
5(Wd[x; cr] — Wd), equation (7) reduces to 

where P{Wd) = (5(W,[x; a] - W^)), P^(Wrf) = {6{W^[^; a] - H^,))«, 
Fluctuation in NESS: In the absence of time-dependent forces, a{t) = aQ, a system 
initially prepared in the steady-state po{x) = pss{x] ctq) remains there and satisfy a 
particular form of the Crooks relation: 

P{Wd) = P{-Wd)e-'^'^ (21) 



2.2. Dual dynamics 

Non-equilibrium steady-states (NESS) are already asymmetric with respect to time- 
reversal due to the lack of detailed balance. This has led Oono and Paniconi [23] 
to introduce a useful two fold decomposition of the total heat exchange into a "house- 
keeping heat" part, constantly produced to maintain the non-equilibrium driven steady- 
state with non-vanishing currents, and an "excess heat" part, produced only during 
transitions between steady-states. The excess heat is minimised in adiabatic processes, 
that is when a{t) varies very slowly compared with an assumed finite relaxation time 
towards the NESS, while the house keeping heat is minimised only at equilibrium, in 
the absence of non-conservative forces, when detailed balance is recovered. Hatano and 
Sasa formalised this splitting for Langevin dynamics by defining stochastic trajectory 
dependent quantities, (^'^'^[xj'^] Q^''[x;o"], for the house-keeping and excess heat 
respectively, and deriving a IFT which generalised the second law for transitions between 
NESS. Although they do not use it for its derivation, they point out that the so-called 
dual dynamics, denoted by the symbol f, composed with time-reversal, plays a role 
analogous to time-reversal alone in the derivation of the Jarzynski equality. 



Joint probability distributions and fluctuation theorems 



9 



Indeed, the adjoint transformation is defined such that NESS are symmetric 
with respect to the simultaneous apphcation of time-reversal R and the adjoint 
transformation f to the original dynamics, that is, with respect to the composed 
"T = i? o f" transformation: the steady-state of the adjoint dynamics has the same 
distribution = pss as the original dynamics but with an inverted steady-state current 
Jgg = — Jss- Since the original current can be recovered by a time-reversal without 
changing pss, the steady-state is symmetric with respect to the composed operation 
T = Ro], It is worth remarking that the adjoint transformation changes the dynamics 
(see paragraph 3.1.2 for an explicit example). It is then natural to introduce the so-called 
trajectory-dependent non-adiabatic entropy production 

5na[x; a] = ln(P[x; a]/pt«[x«; cr^]), (22) 

to measure the asymmetry produced when the system is driven out of the NESS. Here 
-pt^l^x^; 0"^] is the weight of the trajectory x in the time-reversed dual dynamics. In 
Section 2.4 we derive explicit forms for S'na for Langevin and Markov chain dynamics. 
For Langevin dynamics we get 

Q \ 1 r M^'^f ^ • , 1 Po(a;(0)) 

5..[x; -]=-j^ dt -{X- a)x + In (23) 
_ g^-[x;cr] , Po(x(0)) 

" T +'%i(x(r)) ^'^^ 
making a physical connection with the Oono-Paniconi-Hatano-Sasa excess heat. Note 
that here we have used again the freedom to choose the initial condition distributions 
Pq and pi for the "twin trajectories" , the first weighted in the forward protocol of the 
physical dynamics, the second weighted in the backward protocol of the dual dynamics. 
By analogy, it is now straightforward to write FTs. The definition of S^a allows us to 
write, for the average of any observable 0[x; a], the FT generator 

(0[x;cr]e-^-[--]),., = (0[x;a])^^t, (25) 

where {...^^ = J Px ^"'''^[x; a^]... denotes the average over trajectories generated by the 
dual dynamics and controlled by a time-reversed protocol and Slg_[x^; a^] = — 5na[x; a]. 
It is worth remarking here that the above statistical relation is valid for any initial 
condition distributions po and pi and is valid for any r > 0. We can now easily derive 
several relations by making particular choices for O, and po,i- 

• Generating function: By choosing (9[x; a] = e^'^-^)'Sn4'x-<(^]^ with A any number, we 
get 

(^^-xsM^^^ = (e-(i-^)'5na[x;<x«]^^^t^ (26) 

• Non-adiabatic entropy production DFT: By choosing (9[x;cr] = 5(5na[x;o"] — S) 



and defining P{S) = {S{Sn.[^;a] - 5))p„ and P«t(5) = (5(5tf [x;a] - S))!. 



pi 



(5(5„a[x; a] + S))^^, it is straightforward to derive the DFT [20, 19] 

P(^„a)/P^^(-5na)=e^- (27) 
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which is the detailed version of the Hatano-Sasa IFT, if the initial condition is the 
stationary distribution. 

• Hatano-Sasa IFT: By choosing 0[x;(t] = 1 and po{x) = pss{x; a{0)) and pi{x) = 
Pss{x', we obtain the Hatano-Sasa IFT 

(e-(^«^^[--l^^^))p.(.(o)) = 1 (28) 

where Acj) = </)(a;(r); cr(r)) — (/)(a;(0); o"(0)). By using Jensen's inequality we get 

/3(Q^^[x;a]),,3(.(o))>(A0),33(.(o)). (29) 

which is the generalisation of the second-law for transition between NESS. Again, 
this inequality can also be obtained by noting that (5na) is equal to the positively 
defined Kullback-Leibler distance between two probability distributions. For the 
present case, (S) = Pi^L(P[x;cT]||P'f^[x^;a^]) > 0, and the equality is reached 
for processes that are time-reversal symmetric in the dual dynamics. Therefore 
equilibrium in particular, and NESS in general, have (S) = 0, as expected. The 
latter is also true for adiabatic processes, slow compared to an assumed finite 
relaxation time toward the NESS, so that the system is always very close to 
the NESS corresponding to the instantaneous value of cr{t). The absence of non- 
adiabatic entropy production in NESS is actually "detailed": = 0. As shown in 
Section 3.1.2 this can be understood from the definition of dual dynamics and from 
a detailed balance like relation between the transition probabilities of the direct 
and dual dynamics for the same pair of states. 

Finally, we note that equilibrium states are symmetric with respect to R and f. It 
is thus natural to introduce a new quantity to measure the asymmetry produced by 
non-conservative or time-dependent driving forces by using the f operation alone, 

5a[x;(T] = ln(P[x;(T]/pt[x;a]). (30) 

where we note that the twin trajectories are actually the same, the first weighted in 
the direct dynamics and the second in the dual dynamics. In Section 2.4 we derive an 
explicit form for S^, from Langevin and Markov chain dynamics. For Langevin dynamics 
the following relation holds 

c [ 1 ^ r ^+ I ^ • , 1 Po(a;(0)) 

5aX;(T=-/ dtvss[x](T)x + \n (31) 
T Jo Pi{x{0)) 

" T +'%i(x(0)) 

where the steady-state velocity fss(x;(T) = Jssicr) / Pss{x; cy), with pssix;a) = e~'^^^''^^ 
the NESS probability distribution, and Jss the probability current in state-space. We 
also note that the initial condition for trajectories weighted in the dual dynamics pi is 
not reversed. The above makes the physical connection with the house-keeping heat. 
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By analogy with the previous cases, it is now straightforward to write a FT generator 
for this observable: 

(0[x;a]e-^^[-^'^l),„ = (0[x;a])t^, (33) 

where (...)^ = j Vx 'P^[x; a]... denotes the average over trajectories weighted in the dual 
dynamics. We can thus proceed analogously. 

• Generating function: 

^g-A5a[x;<x]^^^ = (e-(i-^)'5^["''^l)t^, (34) 

• Adiabatic entropy production DFT: 

P{S,)/P\~S^) = e^^ (35) 

which is a detailed version of the Speck-Seifert IFT, if the initial condition is 
stationary. 

• Speck-Seifert IFT: By choosing C[x;a] = 1 and Po{x) = pi{x) = pss{x; a{0)) we 
obtain the Speck-Seifert IFT 

(e-^«^^[--l),33(.;.{0)) = 1 (36) 

by using Jensen's inequality we get 

(/3Q^'^[x;a]),,,(,;.(o))>0. (37) 

Again, this inequality can also be obtained by noting that (5a) is equal to the 
positively defined Kullback-Leibler distance between two probability distributions, 
that is, for the present case, (5a) = r'i^L(P[x; a]||P"^[x; a]) > 0. Since the equality 
above is reached for dual-symmetric processes by construction, only equilibrium 
states have {Q^^) = 0. NESS do produce Q^^ because they need house-keeping 
energy to maintain detailed balance violation. In other words, NESS are dual 
asymmetric because the f operation, although keeping pss invariant, invert the 
steady-state current Jss- Therefore, the equality in equation (37) is never reached 
by NESS. At equilibrium, the equality is actually reached, and is "detailed" in the 
sense that Q^^[s.] a] = for each trajectory, since Jss = exactly. 

2.3. Splitting 

By using the operations R and f, related to symmetries of equihbrium and NESS states, 
we have defined the trajectory dependent total, non-adiabatic, and adiabatic entropy 



production functional, 

p[x;a] =P^[x^;a^]e'5["'"l (38) 

P[x; a] = Pt^[x^; a^Je'^-I^^'^] (39) 

P[x;a] =pt[x;a]e'5^[^'"l (40) 
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From the last equation we have 

7't«[x«; a^] = P^[x^; a^]e'5^[''"^'^''l (41) 
therefore, from the second we get 

Comparing with the first we conclude: 

5[x;a]=5l[x«;a^]+5na[x;a] (43) 

only using transformation properties. If we define S^, such that it does not include a 
border term as it is customary, we see that i5|[x^; a^] = iSa[x; a]. This is so because R 
and t only change the sign of 5a. Therefore, we get 

5 = 5a + <S„a (44) 

which is the starting point of the three detailed theorems [19]. However, it is worth 
noting that in [19], Stot have been considered instead of S. This splitting is explicitly 
obtained for Langevin and Markov chains in section 2.4. 



2.4- Fluctuation theorems from joint distribution symmetries 

In a previous work [25] we have shown that the use of joint probability distributions 
for different total entropy production decompositions is a convenient tool for deriving 
a variety of exact expressions for Markovian systems, including many known 
fluctuations theorems arising from particular two-fold decompositions of the total 
entropy production. This was done by first noting that any decomposition of the total 
trajectory entropy production for Markov systems, 5[x; a] = ^^iv4i[x; a], has a joint 
probability distribution satisfying a generalised detailed fluctuation theorem, when all 
the contributing terms are odd with respect to time reversal, ^j[^^j '^^] — ~-4.j[x; a]: 

P(/Ii,A2,...,Am) (45) 



PR(_A,,-A2,...,-A 



M 



with = J2i=i'^i and P{Ai, A2, Am) = {5{Ai — Ai)...5{Am — Am))po- This contains 
the same information as 



R 

po \ /pi 



for {Aj} M arbitrary numbers. It is worth remarking that relations of the kind of the 
previous equation, have been already derived in [6, 29] for time independent a. 

More generally, for a transformation T, we can define a quantity St = 
ln{P[x; (t]/P'^[x; a]}. If we can write iSt[x; a] = ^fl^ a] such that each component 
is odd or even under T, Bf = ejBi with ef = ±1, we get 

P{Bi,B2,...,Bm) _^St (47) 
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or, equivalently 

e-EfliA,:B.[x;a]\ _ /gEf£i(l-A.)^f6f[x;<x]\^ _ (4g^) 
I PO \ /pi 

On the other hand, for a not constrained hst of variables {Cj}fl2, such that Cj = eJCt, 
we can also write 

/ PO \ 'Pi 



or, equivalently 



P{St, C2, C3, Cm) _ St 



e*^ (50) 



A/ 



These relations are interesting as they contain the three detailed fluctuation theorems 
[19] as a particular case for M = 1: For the three transformations T = (R), (f), {Ro f) 
we get, respectively, the DFTs for S, Sa and Sna- As an example, using the above 
relations for M = 2 we can get the following useful identities for Sa and Sna'- 

P{Sa, Sna) = P\-Sa, Sna)e^^ = P^\Sa, -Sna)e^- = P^(-5„, -Sna)e^ (51) 

The last one assuming the splitting S = Sa + Sna- 

Another interesting consequence of (50) and Bayes theorem is that 

PiC2,-,CM\ST) = P^iCl...,Cl\- St) (52) 

meaning that the variables {Ci}fi2 have identical statistical properties in the trajectory 
subensembles determined by the constraints iSt[x, a] = St and S^[>^,a] = —St, and 
can thus not be used to differentiate the original and the transformed dynamics. It is 
particularly instructive to consider variables {Ci}^2 describing a discretized path of a 
certain duration. Following the discussion for the time-reversal case in Ref. [27] we can 
now write, for the particular transformations T = (R), (f ), (P o f), the subensembles 
equivalences 

P(path|5) = P^(path^| - S) (53) 
P(path|^,)=pt(path|-5,) (54) 
P(path|S„„) = Pt^(path^| - Sna) (55) 

As discussed in Ref. [27], and can be appreciated recalling (3), the above expressions 
"map" the statistics of typical trajectories in one forward process, to rare trajectories in 
the transformed process, being the latter backward, the backward-dual or the forward- 
dual process, according to the corresponding involved transformation. 



3. Markovian dynamics models 

So far we have made mostly general mathematical considerations arising from the 
definitions of trajectory entropy productions without specifying the dynamics behind 
the corresponding and different trajectory statistical weights. In this section we analyse 
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two paradigmatic class of Markov dynamics. First we consider the Langevin dynamics 
for systems with configurations lying in the continuum, and described by first order 
stochastic differential equations. Second we consider the continuous-time Markov 
chains describing dynamical systems with discrete configurations, described by master 
equations with well defined transition probabilities. 



3.1. Langevin dynamics 



3.1.1. Generalities For simplicity we consider in the following discussion the case of one 
dimensional Langevin system coupled with a single thermal bath. Our model consists in 
a Brownian particle driven by an external force. In the presence of periodic boundary 
conditions, the steady-state for this system has a non-zero probability current. Our 
results can be easily generalised to more dimensions and many particles (provided the 
temperature is the same along every spatial dimension - see e.g. [58] for a physically 
relevant situation where it is not the case). We also consider in 3.2 the case of discrete 
Markov chains. We start with the Langevin equation 

dU 



X 



dx 



(56) 



where a represents a set of parameters of the system, / is a driving force and ^{t) is 
a Gaussian white noise with variance {^{t)^{t')) = 2T6{t — t'). The parameters a and 
/ may depend on time and a = («,/). For this system the probability of a given 
trajectory in the phase space has the following form 



P[x;a]= j V^P[^]po{x{Oy,ao)J[^;a]6 



x + -g^{x;a) - / - 4 



(57) 



where po is the initial probability density function of the system (at t = 0), P[C,] is 
the probability distribution of the thermal noise and J[x; a] is a Jacobian to be defined 
below. P[C,] takes the following form 



P[^] = U-\r)exp 



1 

4T 



dtm' 



(5J 



where n(r) is a normalisation constant. 

It is instructive to make at this point a formal, but important remark. It is essential 
to specify the discretization scheme {i.e. the choice of Ito or Stratonovich stochastic 
calculus — see [30] for a detailed analysis) of the path integral given in equation (57) and 
all the following ones. In general, the relevant quantities we are interested in (different 
forms of heat) were originally defined in the Stratonovich scheme, and we work using 
this picture. Besides, the Stratonovich discretization is easier to use in our context since 
it is invariant under time-reversal, contrary to the Ito one. In the Stratonovich case, 
the Jacobian in equation (57) reads 



J[x; a] = exp 



(59) 
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As regards time-reversal transformations, an important property of this Jacobian is the 
following: 

J[x;o-] = J[x/j;(Tij]. (60) 

Integrating out the noise in equation (57) and taking into account equation (58) we 
obtain: 

P[x, a] = n-i(r) J[x; a] exp{-/[x; a]}, (61) 
where the Onsager-Machlup action functional /[x; a] writes 



J[x;cr] = -lnpo(a;(0);cro) + ^ ^''^{4^ 



\ dx 



{x;a)-f 



2T 



dU 
dx 



ix;a)-f 



Let us now consider the time reversed probability weight given by 
V^[xr, an] = n"^(r) J[xij; an] exp{-//j[x/j; an]}, 

with 

/ij[x^; ctr] = -In pi(a;(r);(T^) + ^ rftj^ {xr^ + (^^{xr, an) - 



(62) 
(63) 



1 . fdU 



+ ^XR 



dx 



2n 



+ 



(64) 



where pi is from now on the solution of the Fokker-Planck equation of the process at 
time r in order to make a connection with [11]. In this case one can immediately write 
for the total trajectory entropy production 

>S[x; a] = ln('P[x; a]/V^[:s.R; ctr]) = /ij[xij; cr] - /[x; a] = >Ss[x; a] + >S,.[x; a], (65) 

where one identifies the system (reservoir) entropy production iSs[x;(t] (iS,r[x;cr]) as 

Pi{x{T);ar) 



5Jx; cr 



In^ 



Sr\^: a] 



Poix{0);ao)' 



(66) 



(67) 



Consider now the instantaneous stationary probability density function for given values 
of the set of parameters of the system pss(x(t); cr{t)) = e~'^^^^^^'''^^^^'^ and let us add and 
subtract the quantity dtx^{x; a) from equation (65). In this case one finds a different 
decomposition of the total trajectory entropy production in two different contributions, 
the so-called adiabatic and the non-adiabatic contributions 



5a 



Sr. 



dtx 



In 



x; a] 



dx 

Po(x(0);(To) 
pi(x(r);cr^) 



dtx—{x] a) 
ox 



(68) 
(69) 
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We thus have two relevant decompositions 

>S[x; a] = Ss{x; a] + >Sr[x; a] = 5a[x; a] + 5na[x; a]. (70) 

Note that instead of using the Onsager-Machlup action functional /[x; a] one could 
equivalently work in the Martin-Siggia-Rose-Janssen-De Dominicis framework (which is 
more suitable for non-Markovian dissipation [18]). 



3.1.2. Dual dynamics in continuous time When the steady-state probability density 
function for a given system doesn't satisfies detailed balance, one usually introduces the 
dual dynamics in terms of its propagator. In a time discretized picture one defines it 
via the relation: 

pss{xi+i]ai)' 

As can be seen, when detailed balance holds the dual propagator is equal to the 
corresponding propagator for the dynamics of the system. 

In the limit of continuous time we have that Xi = x{s), ai 
x{s + ds), ds — )■ 0. In that case 



K\xi\xi+i] Gi) = K{xi+i\xi; ai 



(71) 



K{x{s + ds)\x{s); <j{s)) ~ exp 
From (71) and (72) we have: 
i^^(x(s + ds)\x{s); (t{s)) ~ exp 



^ds[x+^ix;a)-f 



(72) 



—dsx^{x; a) 
ox 

Now, from (73) we obtain for the general dual propagator: 

cx{t)=x 



dU_ 
dx 



(x; a) + f 



K\x,t\x',t']a) = Il-\t-t') 



DxJ[x; a] exp[— X^lx; a]], 



x(t')=x' 



where 

Xnx; a] 



ds 



xis] 



dx 



x(s);a(s)) + f{s) 



+ x^[x[s)]a[s)) 



(73) 



(74) 



(75) 



and J[x; a] is given by equation (59). Before going beyond, let us write the action (75) in 

T-^y dx 



a more clear way. By adding and subtracting the quantity ^i(^ — /) in the integrand 



of equation (75), we obtain: 



X+[x; 



ds 



1 

4T 



dU 

i{s) + — (x(s);a(s)) - /(s) 



5a [x; a]. 



(76) 



We thus confirm the identification of iSa with the trajectory relative entropy between its 
weight in the original dynamics with its weight in the dual dynamics, as defined in (30): 

P[x;a] 



5a [x; a] = X"''[x; a] - X[x; a] = In 



Pt[x;a] 



(77) 
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The second equality in the previous equation holds for po{x{0)) = pi{x{0)). From this 
remark one obtains as an immediate result the validity of an IFT for the adiabatic 
entropy production 



-5a[x;o-] 



(7J 



To endow the dual dynamics with a physical meaning, one would like to associate 
the dual propagator to an effective Langevin equation {i.e. an effective microscopic 
dynamics). To do so, let us consider the following action: 



Simple algebra shows that: 



ds—= 
AT 



(79) 



Xt[x;(7]- r 
Jt' 



ds 



dx 



,x:a 



dU ^ 
dx 



x]a)- f] -T 



\dx 



,x:a. 



2n 



(80) 



We know that, by definition, pssi^, a) satisfies at fixed a the following stationary Fokker- 
Planck equation: 



dx"^ ' dx 



dU 
dx 



{x;a) - f ]pss{x;a) 



0. 



(81) 



Now, putting pss(a;; a) = exp[— 0(x; a)] in (81) one obtains: 



dU 
dx J \ dx 



\dx J dx^ 



{U~T4>). 



(82) 



We thus get: 



Jeff fx: a] = X"^fx: a] 



ds 



d^ 



Substituting (83) in (74) yields: 



2 dx 



x(t)=x 



2T(p{x]a) -2U{x]a) 



(83) 



K\x,t\x' ,t') = 11 ^{t — t') I DxJefr[x; cr] exp[— Xeff[x; a] 



B4) 



x(t')=x' 



where: 



Jefr[x; a] = J[x; a] exp | ^ ds 



d^ 
dx^ 



(x; 0") — 2U (x; a) 



exp 



t Q2 r 
ds 



2 Jt, ^dx^ 
Let us define now the effective potential: 

2 



/3 



(x; a) — U (x; a) 



V;ff(x;cr) = ^0(x;cr) -U{x;a). 



(85) 



^6) 
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^7) 



From (84) and (87) one obtains that the dual propagator is the propagator 
corresponding, in the Stratonovich scheme, to the Langevin equation: 



d 

i = -g^V^six; a) - f + 



(88) 



where, as can be seen from (56), the force has reversed sign. It is easy now to see that 
when detailed balance holds, this dynamics coincides with the real dynamics (56). In 
fact, in this case we have 0(x; a) = ^[f/(x) — fx — F{T; a)], where F{T] a) is the free 
energy. Substitution of this choice for (p in (88) directly leads to (56). Concluding this 
discussion, we remark that the dual dynamics corresponds to the dynamics of a system 
having the same steady-state probability density function but with opposite probability 
current in the steady-state. 

Finally we can also compute 5na directly from the path-integral representation of 
the Langevin dynamics as 

Po{x{t')-a{t')) 



S-n 



4[x 



/[x; a] = In 



In 



Pi{x{t);a{t)) 
Po{x{t')-a{t')) 
p^{x{t)-a{t)) 



Xt[x^:a«l 



X x: (T 



ds T^ix; a)x. (89) 
ox 



Taking now t' = and t = t, we obtain (23). 



3.1.3. Derivation of known FTs We now use the general symmetry equation (45) and 
the two relevant decompositions obtained above for the trajectory entropy production 
in the considered case in order to reobtain, from an unified point of view, the known 
FTs. First one sees immediately that 

P{Ss,Sr)/P''i-S,,-Sr)=e'^+'^- and P(^a, ^na)/P''(-^a, -^„a) = e^^+^"% (90) 

or equivalently 

(^^-XiSs-\2Sr^ ^ ^g-(l-Ai)5f-(l-A2)5«^^^ ^g-Ai5a-A25na^ ^ (1- Ai - { 1 - A2 )5« ^ ^ ^ 

(91) 

It is worth noting that these relations do not involve dual probability distribution 
functions (PDFs), and thus they can be tested for a physical system with a given 
dynamics. We also note that while one can show both that 5'a and 5'na satisfy separately 
a DFT by using dual PDFs [19], Ss and Sr satisfy a joint DFT although they do not 
satisfy separately a DFT. 

Let us now derive from a unified view the known FTs. Using equation (77) we can 
introduce the dual joint probability density function 



(92) 
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This probability density function is, by virtue of equation (78), correctly normalised 

j dSg^dS^Q^P'^ i^Sg^, »S'na) = j dSi)^dSni^P{ — Sg,, >S'na)c ^ = 

= J dSJS,,,PiS^, 5na)e-^^ = (e-^i = 1. (93) 
Let us first derive the Speck-Seifert DFT [10]. We have 

P(5a) = j d5naP(5a,5na) = j dS^^P\-S,, S^,)e'^ = P\-S^)e'^ (94) 

We can also derive the Chernyak-Chertkov-Jarzynski DFT [20] for the non-adiabatic 
contribution 

P(^na) = J dS^PiS^,S^^) = J d^aP''(-^a,-^na)e^^+^-- = 

= j dS^P^'^iS,, -^na)e^'- = P^^(-^na)e^"^ (95) 

3.2. Markov dynamics 

3.2.1. Settings The symmetry (45) holds for any decomposition of the entropy as a sum 
of terms which are antisymmetric by time reversal. The difficult step is to explicitly 
write such kinds of decompositions. In this section, we consider a continuous time 
Markov process for a system described by discrete configurations {C}, and work out 
such decompositions for that dynamics. The master equation for the probability P(C, t) 
for the system to be in configuration C at time t writes 

dtP{C, t) = Y^ [W{C' C, a)P{C', t) - W{C C, a)P{C, t)] (96) 
c 

where a is an external time- dependent control parameter. A system history consists of 
a sequence Cq, . . . ,Ck of configurations with jumps at times ti, . . . ,tK (see Fig 1). 

h t2 ... tK t = tK+l 

I 1 1 1 1 * 

Co Ci C2 Ck C = Ck 

Figure 1. A history of configurations Cq Ck- Between and ife+i, tlie 

system remains in configuration ■ 

Let us introduce the dual transition rates W^''' 

W\C ^ C, a) = ^"'f}''} wiC' ^C,a) = e-[^(c'.-)-<^(c,-)V(c' ^ C, a) (97) 
Pst{C, a) 

Note that when detailed balance is obeyed (z.e. Peq{C)W{C C) = Peq{C')W{C' C) 
for some equilibrium distribution Peq(C)), the dual dynamics is the same as the original 
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one. We first remark that the dual escape rate r'l'(C,cr) = — )■ C',a) is the 
same as the original one: 

^^C, a) = — ^ ^ W{C' ^ C, a)P.,{C', a) = -j^^MC, a)P.t(C, a) = r{C, a) 

(98) 

More importantly, the steady-state of the dual dynamics is the same since 

J2 W\C' ^ C, a)Pst(C', a) = Y, ^ C\ a)P,,iC, a) = 
c c 
= r{C, (T)P,t(C, a) = rt(C, a)P,t(C, a) (99) 

5.^.^. Entropies The (density of) probability of a trajectory specified as in Figure 1 
writes 

K 

Prob[C,a] = e-^o^'^*-(cW,-W) JJ ^ Cfc,atJ Po(C(0), a(0)) (100) 

k=l 

where K is the number of events and Pq the initial distribution. It precisely means that 
the average of an observable O depending on the history of configurations and on the 
protocol a writes 

{0) = J2Y1 I dtK dtK-i ... r dti 0[C, a] Probp, a] (101) 

By analogy to systems described by Langevin dynamics, one defines the total entropy 

Prob[C, cr 
Prob^[CR,(TR 



5[C,a] = log _-X'^^_^^ (102) 



A ^ W{C,_,^C,,a,,) Po(C(0),^(0)) 

where is the reversed trajectory and the reverse protocol. Note that 5[C,(t] = 
—S[C^, a^]. We now would like to split the action into a sum of different terms, each of 
them also antisymmetric upon time-reversal. To do so, we assume that Pq = Pi is the 
steady state Pst = e""^. Then, we define the 'house-keeping' entropy Q}^^ as 

note that it is indeed antisymmetric upon time reversal: /3Q'^'^[C, a] = —PQ^^[C^,a^]. 
Moreover, we see by direct computation {e.g. from (112) below), that the total entropy 
S writes in terms of the house-keeping work as 

S[C,a]=/3Q''''[C,a]+y[C,a] (106) 
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where 

y[C,a] = l^ta^ (107) 

is the Hatano-Sasa functional. Note that each term of the decomposition is 
antisymmetric. 

Note last that defining A0 = (f){C{t), a{t)) - 0(C(O), a(0)) and 

m'-'ic, = E log Zf;-'"/'-""] (108) 

one reads directly from the definition (103) that 

S[C,a] = (3Q'°'[C,a]+A(l) (109) 

where again each term of this decomposition is antisymmetric. 
To summarise: 



K 



k=l 

52 53 



K 

-5^[0(Cfc,atJ-0(Cfc_i,aiJ] + A0 (110) 

k=l 

The first decomposition consists in grouping f3Q^^[C, a] = S1+S2 and y[C, a] = S2+S3 
while the second decompositions simply corresponds to /3Q*°*[C, a] = Si and A0 = 53. 
We also remark that writing 

K 

S[C,a]=/3Q''^[C,a] - 5^[0(C,,a,J-0(C,_i,a*J] + A0 (111) 

k=l 

one has a decomposition in a sum of three antisymmetric terms implying FTs using (45) 

3.2.3. Link to the Hatano-Sasa functional and symmetries of operators It is instructive 
to rewrite the Hatano-S functional y as 

^^^g^ = Yl / dt &— = ^(f){Ck,(Jt^^,) - 4>{Ck,crt,) 
^ k=o ^ k=0 

K 

= [</'(C,a)];-5^0(C,,a,J-</)(Cfc_i,a,J (112) 

k=l 

We thus have split y in two parts, [0(C, a)] which depends explicitly on the final time 
r, and the reduced Hatano-S functional 

K 

K = -^(p{Ck,(ytk) - (PiCk-i,(7tJ (113) 

k=l 
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which (for fixed protocol cr(t)) depends only on the sequence of visited configurations 
Ck and of the jump times tk- This decomposition helps us to write (e~*-^) in terms of an 
s-modified evolution operator. We show in appendix Appendix A that the DFTs arising 
from the the decomposition (110) of the dynamical entropy translate into symmetries of 
a modified operators of evolutions Wa such that {e~^^) = (Pi|Te™^|Po) where Te' is 
the time-ordered exponential. Compared to the original approach of Hatano and Sasa [9] 
our derivations bring only into play the properties of the operator of evolution (through 
the use of the time-ordered exponential) and do not require a time discretization. 

4. Applications 

4.I. Experimental errors 

4-1.1. General derivation We now show with some detail how joint FTs provide 
insights on the experimental error in the evaluation of entropy productions. The results 
we have shown up to now are rather general and do not depend on the shape of 
the initial and final PDFs for the considered systems under arbitrary protocols. For 
concreteness and in order to be closer to experiments, we consider in this section the 
case of transitions between NESS, so the initial and final PDFs for the system, are taken 
as the ones corresponding to the steady-states of the system with the given values of 
the parameters. 

In this situation, the non-adiabatic contribution to the total trajectory entropy 
production is simply the Hatano-Sasa (H-S) functional [9]: 



Jo 

We are interested in experimental measurements of this quantity, performed for instance 
in [31]. In a typical experiment one follows in general the following protocol: 

• First one measures the particle density in different points and build an histogram 
from where the steady-state PDF of the system can be inferred for different values 
of the control parameters (and correspondingly 0exp(a;; cr) = — In p^^{x] a)). 

• Second, one follows a given particle during a prescribed protocol (sampling its 
position) and build, for the considered realisation of the experiment, the Hatano- 
Sasa functional: 3^exp[Xexp; 0-] = ^ dta^^^^X^^^] o) . 

• Finally, one averages over many experimental realisations the quantity of interest, 
for example one determines the average (exp[— 3^exp[xexp; o"]]) in order to test the 
validity of the Hatano-Sasa IFT. 

Although these settings are very generic, there are cases where the steady-state PDF of 
the system is known, and one do not need to consider this source of experimental errors, 
as in [31]. 

Let us first note that 0exp and Xgxp are not the true values for the quantities one 
is trying to determine in the experiment, but are outcomes from measurements. They 
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thus implicitly carry errors. We can in principle repeat the experiment many times and 
perform an histogram in order to calculate the probability of the experimental values 
of the H-S functional. Imagine the hypothetical situation in which we are also able 
to directly obtain the true value of the H-S functional, from where we can extract for 
each experiment the corresponding deviation of the measured value of y with respect 
to the real one: £^exp[xexp, 2;; c] = 3^[x; a] — 3^exp[xexp; o"]- In that case we are able to 
experimentally build the joint PDF 

P(i;.p, E^^,) = ^;^e^^^-+^^^-Gexp(Ai, A2), (115) 

G'exp(Ai,A2) = (e-^i^-p[^-p''^]-^2^-p[''-p'^;'^]). (116) 

In equation (116), the brackets denote the thermal average while the overbar denotes the 
average over the distribution of experimental measurements errors. Let the conditional 
probability of position outcomes be "Perrixexpla;], that is, the probability of obtaining 
the trajectory of outcomes Xexp(i) being x(t) the true trajectory of the particle. In this 
case, we can write a mathematical expression for the experimental generating function 
(GF) 

G'exp(Al, A2) = J VxVx^^pVlx; 0-]Perr[Xexp|a;] exp { - A i ^Vexp [x expi C"] A2i^exp [Xexpj ^] }• 

(117) 

Note that, by a suitable rearrangement of terms, we can rewrite the previous expressions 
as 

Gexp(Al,A2) = j PxP[x;a]e-^^^[^^'^l j I?XexpPerr[Xexp|x]e-(^^-"^)^-=['^--'^l. (118) 

Let us introduce the quantity 

B[Xi,X2,X;a] = J PXexp^err[Xexp|x]e-(^^-^^)^-^["-^''^l (119) 

Then equation (118) can be written as follows 

G'exp(Ai,A2) = (i3[Ai,A2,a;;a]e-"^^[^^'^]) = (i3[Ai, A2, a]e-^^^['^«^'^]-'5[-^-«l)^, (120) 

where the second equality follows from our generalised Crooks-like relation (see part 2.1), 
identifying the observable C[x; a] with the quantity B[Xi, A2, x; a]e~'^'^-^^^''^^. 

Now recalling that 3^[x/j; a] = — 3^[x; ct/j], and also that the total trajectory entropy 
production splits into the sum of a non-adiabatic contribution (in this case the Hatano- 
Sasa functional), and an adiabatic one, and that weighted averages with the exponential 
of the adiabatic contribution are equivalent to averages over trajectories given by the 
dual dynamics, one writes 

G'exp(Ai,A2) = {B[\,A2,XR;a]e-^'-^'^y^^-^-^%. (121) 

Let us now analyse the behaviour of the quantity i3[Ai, A2, x; cr], when a time reversal 
operation is performed. For that purpose, let us impose some physically acceptable 
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and general properties on the conditional error distribution: we assume that the source 
of experimental errors associated to '^[xerrl^;] (the shape of the distribution) does not 
depend explicitly on time neither on the form of the experimental protocol. This error 
is basically related to some inherent properties of the measurement apparatus. On the 
other hand, we assume that there is no memory in this distribution: the outcome of the 
measurement at time t is only related to the true value of x at the same time (this has 
indeed being implicitly assumed in the notation for this probability density). We finally 
assume that this distribution does not depend on any time derivatives of the involved 
variables. From all this requirements, the distribution ^[xej-rlic] is invariant upon time 
reversal 

P[xe„|x] =P[xf„|x^J. (122) 

We can then write 

S[Ai,A2,X^-a] = j PXexp^err[Xexp|a;H]e-(^^-^^)^-^["-^''^l (123) 

Make now the change of variables Xexp = zr. Note that this transformation has a 
Jacobian identically equal to one, and that 3^exp[x2cp, o"] = — 3^exp[xexp, o"/?], which in 
fact, comes from the definition of 3^exp- We then have 



'(Ai-A2)yexp[z_R;o-] 



= J P2Perr[2|x]e-[('-^^)-('-^^)]^^='P["'"«l, (124) 

which in fact means 

i3[Ai, A2, xr; a] = i3[l - Ai, 1 - A2, x; (125) 

Using now (120), (121), and (125), we obtain 

Gexp(Ai, A2) = Gl^il - Ai, 1 - A2), (126) 

from where one immediately obtains 

P(nxp, ^exp)/P^''(-nxp, -^exp) = e^-^+^-^ (127) 

From the last expression, or by simply using Ai = 1, A2 = in (126) we obtain, for 
example, the relation 

^g-3^exp[Xexp;o-]^ _ g-fexp [x.Xexp ;o-] ^ ^ _ (128) 

From the analysis of (e^^^='p)|j for specific cases of experimental errors, one can estimate 
the dispersion of the experimentally obtained (e'^^'^f) around (e"-^) = 1. 
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4.1.2. Experimental errors for a driven particle in an harmonic trap Let's now consider 
for concreteness an exactly solvable case illustrating the validity of the derivation 
we made above. We focus on the experiment of Trepagnier et al [31]. In the 
considered experimental situation, a microscopic bead is dragged through water by using 
a steerable harmonic optical trap. In this case, treating the bead as a Brownian particle 
in a harmonic potential, the steady-state distribution for the system was obtained 
theoretically. In the experiment the velocity of the trap plays the role of the tunable 
control parameter. For more details on the experimental setup and on the definitions, 
see [31]. In the given case, the Hatano-Sasa functional writes 

y[x;v] = —[ dtv{Kx + -fv), (129) 
^ Jo 

where k is the trap constant, 7 is the friction coefficient of the bead in the solution and 
/3 is the inverse temperature. 

The experimental Hatano-Sasa functional and the error, can then be written as 
follows 

yexp[^exp;v] = — f dtV^KXexp + 'fv), (130) 

Jo 

£:exp[x, Xexp;^^] = /37 / dtv{x-Xexp)- (131) 
Jo 

We assume that the general conditions we assumed for 'Perr[x|a;exp] = 'Perr[x — x^^p] are 
valid here. Consider now the generating functional of this conditional probability, which 
we denote by Ggj.j. 

GiriJ] = J VT]V,rr[v]e~'^'^''"^'^''^'^. (132) 

Then, rearranging equation (117) one has 

Gexp(Al,A2) = J VxV[^;a]e-^^y^^-^'-^ J I?XexpPerr[x - Xexp]e-(^^-"^)^-^['^-"--'^l = 

= G'L [ - i{\2 - \i)hv] (133) 
Taking into account that v = —vr, we have 

axp(Ai, A2) = [- z((l - A2) - (1 - A0)/37t^«] (e-(^-'^)^[-^'^-J^^ 

(134) 

which is the result we have obtained before. 

In order to conclude with this section, let us exploit the solvability of this model 
in order to show that indeed there is a link between the apparatus precision and the 
experimentally relevant measured quantities. For example, in this case one has 



(e-ye.p[xe.p;.]) = Gexp(l, 0) = Gi, [t/S'yv] , (135) 



from where we see that the experimental mean value of the exponential of the Hatano- 
Sasa functional, is solely and directly determined by the distribution of measurement 
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errors in the position of the particle. For example, in the case of an extremely precise 
measurement, one has G^^^ = 1 ^ (e~^'=='p) = (e~-^) = 1. Consider now the case in 
which the experimental error conditional distribution is Gaussian, i.e. 

~ exp I - ^ j^^"^'^^^] ^ ^^'-''^^ = { " T j^^-^'^^^] ^^^^^ 

In this case, one sees that the experimental deviation from the Hatano-Sasa IFT is 
linked to the accuracy of the measurement apparatus: 

-log(e-^-p[''-p;'']) = I dtv^{t)<0, (137) 

2 Jo 

which is compatible with the experimental results of [31]. We learn from the last 
expression that, at very high temperatures, the "violation" of the fluctuation theorem 
introduced by the lack of accuracy of the apparatus can be cured by thermal fluctuations. 
On the other hand, rapidly varying protocols may induce a remarkable enhancement of 
the referred "violation" factor. 

4.2. Generalised FDT, identities on correlation functions 

In this section, we use the second equality in (91) in order to find some symmetries 
on correlation functions related to a generalised fluctuation dissipation theorem (FDT) 
derived e.g. in [32, 33, 34, 35, 36, 37, 38, 39] (see [40] for a review). Let us consider the 
situation in which the system, initially prepared in a NESS, is submitted to the variation 
of its parameters aiit) = + 5ai{t) in such a way that |^^^| ^ 1, with = o"i(0) and 
5(jj(0) = 0. In this context, within the particular form of [36], this generalised FDT can 
be written as follows 

(^^^(x{t),ao)'^ =J2 1^ X^,{t-t')Sa,it')dt', (138) 

where 

= |c«(*-0 = |(|^(.-W..o)||w/)..o))__. (139) 

For a system performing equilibrium dynamics, where detailed balance holds, this 
correlation function satisfies the well known Onsager symmetry relation Gij{t — t') = 
Gij{t' — t) = Gji(t — t'), however, in the most general case of a NESS, this relation breaks 
down because of the lack of detailed balance. However, a similar relation can be easily 
obtained for this case: Cij {t-t') = Gjj {f - 1) . The physical meaning of this expressions 
is clear. One is performing a time reversal operation. When detailed balance holds, 
there are no probability currents in the system and this implies invariance upon time 
reversal. In this case the system and its dual are the same. When detailed balance 
breaks down, there is a finite current in the steady-state, which is odd under time- 
reversal. In this case, the original dynamics is equivalent to the time reversed dual one 
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(which as expected has a current opposite to the original one). This relation, although 
conceptually clear, however, does not seems to be useful: it involves correlations in two 
different physical systems. The question which comes now is: does it exist a suitable 
correlation function capable to exhibit a symmetry involving only the system under 
study? The answer is yes. We now discuss briefly the physical grounds behind this 
correlation function. 



4-2.1. Dynamical ensembles and weighted averages In a full equivalence with 
equilibrium thermodynamic ensembles, one can build trajectory-based ensembles for 
stochastic non-equihbrium systems, together with quantities equivalent to the partition 
function and the free-energy — in a dynamical thermodynamic formalism [41]. 
For equilibrium systems with a Hamiltonian H{C) depending on configurations in 
the phase space, one defines in the canonical ensemble a free energy F{P) = 
— (1//3) In exp{— /3if(C)}, and averages of observables can be computed as (y) = 
YlicV^^) ^^P {/^(-^(/^) ~ H{C)) }. The inverse temperature (3, is a Lagrange multiplier 
fixing the mean value of the energy, so that plugging a given /3 privileges in the sum the 
configurations compatible with a prescribed value of the mean energy. 

Now consider, for a dynamical system, a time extensive functional /C[x] = 
j^dt' f {x{t')^. The s-ensemble, very similar to the canonical ensemble in equilibrium 
statistical mechanics, is defined by the average 

^ /P[x]P[x]y[x]e-^M 

/©[xjPMe-^'CM ■ ^ ' 

This approach has proven to be useful in the study of dynamical phase transitions [42, 
43, 46, 45, 44]. 

The conceptual idea behind the use of the parameter s is the same as in the case of 
the inverse temperature in canonical ensembles: in the long time limit, fixing the value 
of s allows one to calculate averages of functionals, not for typical trajectories but for 
atypical ones, where the mean value of the time extensive functional /C[x] is fixed. In 
other words, weighted averages select trajectories compatible with a prescribed physical 
scenario. The presence of this parameter imposes some constraints on the system in 
favour of rare events, by introducing a well-chosen bias on the evolution of the system. 

Even if the question of dealing experimentally with those biased trajectories is 
actually far from being answered in a closed form (see however [47]), the procedure is 
interesting from a conceptual and numerical [48, 49, 50] point of view. 

Let us now turn again to our problem. The symmetric nature of the correlation 
function when the system is in equilibrium breaks down as detailed balance does for 
systems with finite currents in the steady-state. However, one can guess that, if one 
finds an appropriate time-extensive functional defining weighted averages, the symmetry 
will be restored for a given value of the Lagrange multiplier. The only thing we need 
is to average, in non-equilibrium systems, only over trajectories compatible with some 
equilibrium effective dynamics. We deal with this in more detail in what follows. 
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4-2.2. Restoring the symmetry of the correlation function using weighted averages We 
first combine equation (91) with equation (7) to write 

Q^^.^fjjQ->^lSn4^;cr]-X2S4x;cr]\ ^ j^i?. ^jg-{l-Ai)5na[x;o-f']-(l-A2)-Sa[x;o-f*] \ ^ (141) 



Let us now choose 0[x; a] = exp{— A2J^[x; cr]}, with J-'[x; cr] = J^[x'^; a]. With this we 
can write 

R 

,-Ai5„a[x;cr]-A25a[x;f7]-A2J-[x;a] \ _ / ^-(l-Ai)5„a[x;cr«]--(l-A2)5a[x;<T«]-A2J-[x;cr] 



g-Ai6nalx;crJ-A26alx;CT]-A2>[x;a]^ ^ ^ g- (1- Ai)6na[x;(T'^J-(l- A2)6a[x;<T'^J- A2> lx;crj ^ (142) 

Let us note now that we can write, to second order in the small perturbations 6a 
g-A,5„a[x;.] ^ 1 _ Ai V r dt6&,{t)^{x{t),ao) - 

. Jo '^^i 

-Ai^ / dtSaiit)Sajit)^^{xit),ao) + 



and 



g-{l-Ai)5na[x: 



^ 1 _ (1 _ x,)J2l^dt6af{t)^^{x{t),ao) - 
1 - E f dt5a^{t)5af{t)^^ixit),ao) + 

J2 dtdt'5af {t)5df{t')^{x{t), ao)^{x{t'),ao), (144) 



^(1-Ai)^ 



2 



Plugging (143) and (144) in (142) and equating the terms with the same power of Ai, 
we obtain a set of equalities. Let us consider the one corresponding to A^: 



-A25a[x;o-o]-A2J"[x;o-o] 

'0 ^'-'i '-"-'j I SS 



dtdt'S&i{t)S&j{t') — {x{t),ao)-7^{x{t'),ao)e~ 

5^ r dtdt'5af{t)5af{t')^{x{t),ao)^W^ . (145) 

In the previous equation, the averages and the functionals in the exponentials can be 
taken in the steady-state a = ctq, because we are considering only the second order in 
6a. In the second term of the previous equation, we perform the change of variables 
t ^ T — t and t' — )■ r — t' in the double integral. Then, the last equation is equivalent 
to the following identity 



V rM'5a,(t)5d,(t0|^(x(t),ao)|^(x(t0,cro)e-'^^^t^^^«l-"^-^t^^-l 
^ Jo da, daj 

J2 f dtdt'Sai{t)Sa,{t')^{x'^{t), ao)^(x^(t'), ao)e-^'-'''^^^^''''''^^^'^^''-^^A . (146) 

i 4 ^ 'SS 
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If we finally take A2 = 1/2, we obtain a symmetric relation 

V f dtdt'5a,{t)5a,{t')^{x{tU,)^{x{t'),a,)e-^^^^^^ 

y l\tdt!balt)baAt!)^{x\t),a^)^{x''{t!),a^)e-^^l'^^^^^^ . (147) 



Ci,-(r,0)e-^^/'^^''^^"''^»l+-^'"''^°J^ ) = /Ci,(0,r)e-^^/'^^''^'"''^°J+-^^"''^°M , (148) 

ss \ / ss 



From the last expression, we can write 

-(l/2)(5a[x;<7o]+J-[x;ao])\ ^ /r..{r\ ^^|^-(l/2)(5a[x;ao]+J-[x;ao]) 

where 



C^At,t') = ^{x{t),ao)^{x{t'),ao). (149) 

Up to now, what we have done is very general and the functional J-" can be any quantity 
being invariant upon time reversal. In the discussion below, we consider some physically 
relevant choice of this functional. 

4-2.3. Mapping to an effective system with equilibrium dynamics Let us consider the 
following Langevin evolution 

We know that exp{— 0} is a well-behaved distribution: it is continuous and with 
continuous derivatives at least up to second order. It is also correctly normalised. 
On the other hand, this function corresponds to the stationary solution of the Fokker- 
Planck equation associated to the process (150). This is thus the steady-state of this 
equation which, if cj) is non singular in any point of the space (excluding the infinite), 
is unique. Interestingly, we remark that for the dynamics (150) there are no currents 
in the steady-state, so that detailed balance holds and the system performs equilibrium 
dynamics. The steady-state is the same for both the system (150) and the original 
system under study described by the evolution equation (56). 

The effective action of any process has always a part being odd upon time reversal, 
which is related to entropy production, and an invariant part, which is related to the 
activity, which for Langevin dynamics in a potential V and with additive white noise, 
reads 



Rv{t) 



[ dt 

Jo 










\^dx ^ 


/ 2 (9x2 _ 



(151) 



The quantity exp ( — (3dt^), is proportional to the probability that the system has 
stayed in its configuration between t and t + dt [51]; in other words, is the 

rate at which the system escapes its configuration, and is related to the activity (or 
"traffic") [41, 52, 53, 54]. 
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Let us investigate how far is our original system from the "equihbrium" system 
(150). For that we are going to introduce the distance between them in the usual way: 

S[x; a] = In (P[x; aJ/P^x; a]) = ^ (^5a[x; a] + 2(i?4x; a] - Ru[^; a])^ . (152) 

such that (S[x;(t]) > is the Kullback-Leibler distance between P[x;cr] and P^[x;cr]. 
This quantity satisfies the corresponding IFT: 

(e-^[--]) = (1)^ = 1. (153) 

Considering then the s-ensemble built using the quantity S, we constrain our system 
to trajectories compatible with the dynamics (150). In particular, averages over the 
steady-state of the original system lacking of detailed balance, are directly mapped to 
an equilibrium steady-state, with zero currents. Defining this average as 

{oy = ^ 7 154 

we see that averages in the steady-state with s = 1 are mapped to averages in 
equilibrium, (. . .y^^ = (. . .)eq. If we take in equation (148), J-" = 2{R^ — Ru), this 
weighted correlation function acquires an interesting physical meaning. In order to 
clarify it a little bit, let us consider the generalised FDT given by (138) in the case 
where the underlying dynamics is given by (150). In order to avoid confusions, let us 
clarify the notation even if it will be the same already used. For averages under the 
original dynamics with varying protocol a, we use the symbol (. . .) whereas for averages 
under the original dynamics with constant a = ctq, we use the notation (. . .)ss- On the 
other hand, for averages under the dynamics given by equation (150) with varying a we 
use (. . .)0 whereas for averages under this dynamics for constant a = ctq, we use (. . .)eq. 
We will have 

where 

X?« - - - t') ^ |(|i(.(i,,..,^(.(0,.„))^ . (156) 



To the same order in 5(T, this implies 



d(Ti 



x(t),ao)e-=°W^ = J2l\^{t-t')6a,{t')dt', (157) 



where 



_ . |c-(* - ^ |(|i,.W...)|i(.,0,.„)e-..')_ , ,158 
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and So(t) = H[x;cro]. Let us now introduce the notations aiif) = g^(x(t),cro) and 
bi{t) = ^(a;(t), cro)e^"°*^*^ Then, one can rewrite the two previous equations as 

iHt)) = Yl f ^^{t-t')5<y,{t')dt\ (159) 

with 

X'^{t - t') = jC^{t - t') = |(6.(t)a,(t'))ss. (160) 
Then, equation (148) corresponds to the symmetry upon indices interchange: 

C^^(t-t') = C^t{t-t'). (161) 

5. Conclusion 

We have reviewed, for continuum and discrete systems following a Markovian dynamics, 
how symmetries of the dynamical entropy translate into detailed or integrated 
fluctuation theorems, in terms of the symmetries under particular transformations of 
joint probability distributions. 

From a conceptual point of view, the FTs given in (90) provide a convenient 
perspective to understand the interplay between different contributions to the total 
entropy production. The first of these equalities shows an explicit relation between the 
entropy production fluctuations associated to the system and its environment, valid at 
finite time and without quasi-static assumption. It allows one to study the correlations 
between the two sources of entropy production. The second relation unifies the three 
detailed FTs derived in [19]. The relevance of this expression is twofold. First, it implies 
the previously known FTs, and secondly, it gives a relation between the fluctuations of 
these two different entropy productions without relying on the dual dynamics (which 
is useful from an experimental point of view since one does not need to run a second 
system with the dual dynamics) . In practice, to compute the contributions to the total 
entropy production, one needs to measure the ratios between transition rates, the PDF 
of the system at initial and final times, and the PDF in the steady-state — which is 
achievable (see [55] where ratios between transitions rates have been measured). In the 
case of continuous Langevin equations, only the PDFs have to be measured. In any 
case, (90) is thus of experimental use. 

It is known that fluctuation theorems provide a non-equilibrium way to measure 
physically relevant properties of single molecules (such as conformational free energy 
differences, see [2] for a review). We have proposed two other outcomes: a way 
to estimate experimental errors due to fluctuations in measurement apparatus and a 
modified non-equilibrium fluctuation-dissipation relation (FDR) (see also [36, 37, 38, 
39]). 

In the first case, we have studied the experimental measurements of, for example, 
the Hatano-Sasa functional. We have demonstrated that the joint PDF of the 
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experimentally measured values and the error of each measurement satisfies a FT, which 
allow to extract precise information about the infiuence of error sources on the results. In 
particular we have obtained an exact expression for the "violation factor" of the Hatano- 
Sasa IFT in the simple case considered in the experiment of Trepagnier et al [31]. It 
is worth noting that our results are compatible with the experimental measurements. 
We have explicitly obtained that for protocols with higher dissipation the experimental 
results are farther from the expected ones than those of protocols with lower dissipation. 
This fact is observed in the broadening of errors bars as dissipation increases. Using 
the same ideas, one can study some other family of interesting systems: those with 
feedback, where the external protocol imposed to the system depends on the outcome 
of some measurement which can be carried out with some error. 

In the second case, we have obtained new symmetries for correlation functions 
linked to modified FDRs. Those symmetries are based on the use of weighted averages 
which introduce some bias in the system such that, controlling this weight, one forces 
the system to prefer some trajectories in the phase space. We have indeed shown that, 
for a particular form of this weight, the dynamics of the system is exactly mapped to 
the dynamics of some equivalent equilibrium system, giving a physical meaning to these 
symmetries. Although the result looks artificial, it can be reformulated in terms of 
generalised forces and currents, giving the possibility to recover Onsager reciprocity in 
the linear regime in the vicinity of a NESS [56]. 

Last, let us note that joint PDFs-FTs can be relevant in other contexts. Consider 
for example a set of strongly connected systems which do not satisfy a FT for any of the 
entropic contributions of its constituents. In this case, the most precise information one 
can obtain involves contributions from all the subsystems. This can be seen in classical 
systems but also in quantum situations. For example, some recent modified FTs have 
been obtained for counting-statistics of electron transport in quantum dots, coupled to 
quantum point contacts which play the role of measurements apparatus continuously 
monitoring the system (see for example [57] for recent developments and a discussion 
on the effects of the back action of the environment on the system). An extension of 
our procedure to quantum systems may also give some general framework to tackle such 
problems §. 
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Appendix A. Symmetries of operators 

In this appendix we show that the FTs are equivalent for continuous-time Markov 
processes to symmetries of the modified operator of evolution, in the spirit of Lebowitz 
and Spohn [6]. 

Appendix A. 1. Operator approach 

We take the notation of part 3.2. Let's denote P{C,h,t) the probability of being 
in configuration C at time t, having observed a value h of the reduced Hatano-Sasa 
functional (113), and having started from configuration Cq. The equation of evolution 
writes 

dtP{C,h,t) = ^W{C' -^C,a)P{C',h+(f){C,a)-(f){C',a),t)-W{C -^C',a)P{C,h,t) 
c 

The Laplace transform P{C, X,t) = J dh e'^'^P{C, h, t) obeys 

dtP{C, X,t) = J2 [e-^t'^('^''"^-'^('^'")V(C' ^ C, a)P{C', A, t) - W{C C, a)P{C, A, t) 
c 

or, vectorially dt\P{\, t)) = Wa|P(A, t)) with a time-dependent operator Wa of elements 
(Wa)c,c' = e-^['^('^'''^)-'^('^''^)V(C' ^ C, a) - 6c,c'r{C, a) (A.3) 
where r(C, a) is the escape rate from configuration C, defined as: 

r(C,a) = 5^H^(C^C',a) (A.4) 

c 

Our quantity of interest, (e^'**-^) = e^^^''^''^^ writes 

(e-^^) = J2 PstiCo; (To) [ dhJ2 Pi^, k r)e-^V-^['^('^0''^«)-'^('^''^-)l (A.5) 

Co C 

= e-^*('^'"-)p(C, A, r)e-(i-^)'^('^°'"«) (A.6) 

C,Co 

^ ^/g-A</,(C,,7O|'7-g/J"WA|g-(l-A)0(C,ao)\^ (^^j^) 

where generically |/(C)) denotes the vector of components /(C). The time-ordered 
exponential 

/ Wa = V / / dtn-i ... dt^ Wxit^) . . . WA(ti) (A.8) 

^0 / n>o>^0 



solves dt\ip(t)) = Wx(t)\ip(t)) as easily checked. 
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Appendix A. 2. A primer: the case A = 1 (original Hatano-Sasa equality) 
From (A.7) one has (e~^) = {e-'^^^'''-^Te^o'^^=^\l) but 



c 



= 
(A.9) 



since by definition of steady-state 

Y [e-^^^''''^W{C' ^ C, a) - Sc,c'r{C, a)e-*(''''^)] = (A.IO) 
c 

wliicli means tliat (e~-^) = 1 as expected. Note tliat tlie derivation we liave presented 
makes no use of time-discretization or chain rules compared to [9]. 

Appendix A. 3. Symmetry for the Hatano-Sasa large deviation function 
Starting from (A.7) one has (denoting A^ the matrix transpose of A) 

One checks e.g. from (A. 8) that the transpose of the time-ordered exponential writes 

{Tefo^^f = re^oi^fr (A.12) 

where is the operator of evolution with the time-reversed protocol cr^(t) = a{T — t). 
Besides, 

= e-^[*('^''^")-<^('^''-^)lw^(C ^ C, a^) - ScMC, a) (A.14) 

^ g-(i-A)[^(c',<xR)-<^(c,.H)]^t(c' ^ c, a^) - 5c,c'r\C, a) (A.15) 

which shows that 

(W^)"^ = (Wf_,)t (A.16) 
Using now (A.ll) and (A.12), one arrives at 

(e-^^) = (e-^^->^)^(C'-?)\re^o(K^>.)^\e~^'f''-^'''o)^ (A. 17) 

Since the dynamics of rates W and have the same steady state and hence the same 
0, we read comparing with (A.7) that the large deviation function (Idf) at s for the 
protocol a is the same as the Idf at 1 — A for the time-reversed protocol and the dual 
dynamics: 

/i(A,r;a) =/it(l-A,r;or^) (A.18) 
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Appendix A. 4- Connection with Lebowitz-Spohn-like current 

In [6] Lebowitz and Spohn introduced a history-dependent observable Q obeying a 
Gallavotti-Cohen-like symmetry for Markov process with time-independent jump rates. 
We may generahse their approach by defining, for a given history and a fixed time- 
dependent protocol cr 

where hr is the reduced Hatano-Sasa defined in (113). Note that when the protocol is 
time- independent, the contribution hr to Q merely sums up to (piCx) — 0(Co), and one 
recovers the Lebowitz- Spohn definition of Q. Moreover, detailed balance is equivalent 
to having = for all histories. One studies here the symmetries of i^e~^^~'^^^) . 

In the same way as above, one may introduce the probability P(C, /i, of being 
in configuration C at time t, having observed a value h of the reduced Hatano-Sasa 
functional and a value Q of the Lebowitz-Spohn one — having started from configuration 
Cq. Following the same steps, one checks that the Laplace transform 

P(C, A, t) = j dhdQ e-^'^-^^P{C, h, Q, t) (A.20) 

evolves according to 5t|P(A,K,t)) = Wa,k|-P(A, t)) with a time-dependent operator 
Wa,k of elements 

(Wa,k)c,c' = e-(^"'')['^('^''")-'^('^'")V(C' ^ C, a f-'^WiC' C, a)"" - 6c,c'r{C, a) (A.21) 
One checks that upon transposition the operator possesses the following symmetry: 

(Wa,.)^ = Wi_A,i-« (A.22) 
Using now that as in (A. 7) our quantity of interest (^e~'^-^^'^^^) writes 

^g-Ay-«Q.^ = ^P,t(Co;cro) [ t//it;g^P(C,/i,g,r)e-^'^-'^^e-^[^('^"'"")-^('^'"-)] 
Co c 

(A.23) 

^ ^g-A0(c,<7O|'7-g/J"WA,„|g-(i-A)0(c,<7o)N^ (A.24) 

and using (A. 11), (A. 12) one obtains that the large deviation function ^{X,K,,t) defined 
as fi{X, K, r; a) = log{e~'^-^~'^'^^) possesses the symmetry (at all times) 

/i(A, K, t; a) = /i(l - A, 1 - K, r; a^) (A.25) 

Note first that no reference is made here to the dual dynamics. This also writes 

^e-Ay-KQ.^ _ (e-(i-^)^-(^-")'3-)^R (A.26) 



Joint probability distributions and fluctuation theorems 36 
Moreover, focusing on the case k, — one sees that 

(e-^^) = (e-(i-^)^-«),a (A.27) 
which the equivalent of the equahty 

5a[x^; t] = ^i-a[x; a^] + /3ghk[x; a^] (A.28) 

vahd for systems with Langevin dynamics. In the same way, for A = 1 one sees that 

{e-'^) = 1 (A.29) 

This shows that Q plays for Markov chains the same role as PQhk for systems with 
Langevin dynamics. 
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